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(54) Cmos image sensor with extended dynamic range 



(57) A X-Y addressable MOS imager sensor meth- 
od and apparatus wherein a semiconductor based MOS 
sensor having an array of pixels forming the X-Y ad- 
dressable MOS imager, the X-Y addressable MOS im- 
ager having a plurality of the pixels such that each pixel 
within the plurality of pixels has a photodetector with a 
reset mechanism that adjusts the photodetector poten- 
tial to a predetermined potential level employs the 
measuring a plurality of reset levels with two different 
elapsed times between reset and measurement of the 
reset level, a comparison circuit operatively coupled to 
the means for measuring to determine a difference in 
reset levels, a predetermined set of transfer functions 
used to identify effective signal levels of the photodetec- 



tors, and determines from the difference which transfer 
function is applicable to that photodetector range of ac- 
cumulated light. In response to the difference detected, 
transfer functions are applied to the charge read out 
from the photodetector. The transfer functions comprise 
a first transfer function that is pre-photodetector satura- 
tion function and a second transfer function that is a 
post-photodetector saturation transfer function. These 
transfer functions are applied to two reset levels of the 
photodetector within the same row readout period. The 
response to the difference can be the application of a 
series of digital adds and digital multiplies. The differ- 
ence between the 2 reset levels is used to calculate the 
effective pixel signal level from the difference. 
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(54) Cmos image sensor with extended dynamic range 



(57) A X-Y addressable MOS imager sensor 
method and apparatus wherein a semiconductor based 
MOS sensor having an array of pixels forming the X-Y 
addressable MOS imager, the X-Y addressable MOS 
imager having a plurality of the pixels such that each 
pixel within the plurality of pixels has a photodetector 
with a reset mechanism that adjusts the photodetector 
potential to a predetermined potential level employs the 
measuring a plurality of reset levels with two different 
lapsed times between reset and measurement of the 
reset level, a comparison circuit ope natively coupled to 
the means for measuring to determine a difference in 
reset levels, a predetermined set of transfer functions 
used to identify effective signal levels of the photodetec- 
tors, and determines from the difference which transfer 

6 




function is applicable to that photodetector range of 
accumulated light. In response to the difference 
detected, transfer functions are applied to the charge 
read out from the photodetector. The transfer functions 
comprise a first transfer function that is pre-photodetec- 
tor saturation function and a second transfer function 
that is a post-photodetector saturation transfer function. 
These transfer functions are applied to two reset levels 
of the photodetector within the same row readout 
period. The response to the difference can be the appli- 
cation of a series of digital adds and digital multiplies. 
The difference between the 2 reset levels is used to cal- 
culate the effective pixel signal level from the difference. 
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Description 

[0001] The present invention pertains to semiconductor based image sensors and more particularly to Active Pixel 
/ aoo\ ~r D Qec h/* Pivpi imaae sensors (PPS) having increased dynamic range. 
s ^^^^S^^^i^ contains^ a photo-sensing means and at least one other 

respect to the tins, noise level of the sensor, (o noise ). This is shown in Equation 1 . 

DynamicRange^./o^ E ^ at,on 1 

[00031 .mage sensor devices such as charge coupled devices (CCD) that integrate charge ^^^7^ 

a . Due to the limitations on Vsat, much work has been done .n CCD's to decrease o TOiS e to very low levels, lypi 

dynamic range for both APS and PPS tKvces_ ' correlated Images efflh varying inte- 

thresho.d a, taught by ; Ifonum, m US . pafont 5^0 M3 £ ^ ^ Aps Us ,„ g 0ual ^ 

^7p Sad^^^S-Ca^d 
^ogarhhrefctrenetartanc^^ 

1Q99 IEEE Workshop on Charge-Coupled Devices and Advanced Image Sensors, pp. 191-194, I* Ricquier, et 

I educes and Advanced'mage Sensors, . J. Huppertz et a... "Fast CMOS knr^hW ^ 
IEEE Workshop on Charge-Coupled Devices and Advanced Image Sensors, pp. -4; and (4) varying the level < the 
-t ^te during integral as des^ 

l^en^^^ 

dynamic range of solid state image sensing devices. Konuma shows a means to mcrease ^<£^ V ~££ J 

'haTsuppned to the comparator input. The device then provides only the number of counter clock penods as an output 

5S5T ^hi^S:^ of SS^provide increased dynamic range through effective, increasing V_ 

" io^R^ a counter and comparator in each pixe.. the number of component, in each pM 

sT™ lar q rSadU to a pTxel wtth a very small fill factor or a very large pixel. This approach is not practice g-ven the 
prlsen Z^T^sL of stated the art semiconductor techno.ogy. and the need for small p.xel, low cost 
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image sensors. 

[0009] Second, the output for each pixel is a counter value for the time required to reach a given threshold, and 
does not contain an analog output value for the actual amount of charge integrated in the photodetector. With this 
approach, although the effective V sat level is increased, the effective DR will be limited by the time period or accuracy 

5 of the counter clock, and the size of the counter. For example, if the counter has 1 0 bits or 1 024 counts, the dynamic 
range is extended to 10 bits provided that the 1024 master clock periods can fit into the desired exposure time. If the 
desired exposure time were 100 msec, then the counter clock period must be< 97.6usec. If one were try to extend the 
DR to 20 bits, a 20 bit counter would be required, and a counter clock frequency of > 10.5 MHz for an exposure time of 
100msec. In this example, the extension of the DR from 10 to bits results in a clock frequency requirement that is 1000 

10 times faster. As the exposure time decreases a commensurately faster master clock Is required. For example, if an 
exposure time of l/60 th of a second were desired or required in the case of capturing an image in outdoors in bright 
sunlight, a master clock of 63 MHz would be required to quantize 20 bits. It is evident that very fast counter clocks are 
required to provide high dynamic range in typical exposure conditions. Also, as the number of bits in the counter gets 
larger, more area required to integrate this into the pixel, producing a larger and larger pixel. Typical counters require 4- 

w 8 transistors per bit. Thus a 20 bit counter would require 80-1 60 transistors, yielding pixel sizes of> 40um in a 0.35um 
CMOS process. Additionally this approach requires that all pixels within the image sensor reach the programmed 
threshold level in order to have an output value for each pixel. This would require very long exposure times to allow dark 
regions of the scene to reach the threshold level if the threshold level is near V sal . The exposure times could be 
decreased by programming the threshold level to a very low value, but this would reduce the accuracy of information in 

20 very bright regions of the scene since they will reach the threshold value in extremely short time periods. 

[0010] Thirdly, with the approach of Konuma. at the brightest light levels the data is more quantized. This is shown 
is Equation 2 by looking at how the effective light measurement is calculated from the time to threshold. 
[0011] If one knows the amount of time (t T ) required to reach a threshold (V T ) and assume that the source is con- 
stant over the time being measured, then one can calculate the amount of light at any arbitrary time, (t M ). The expres- 

25 sion for the extended effective voltage (V ext ) is given by Equation 2 below. 



Equation 2: 




35 



45 



[0012] In a discrete system the time variable, t Jt would be measured by a quantized unit as indicated in Equation 3. 

7 MaxCv] 



Equation 3: t T = *" — I 



ao Where cv is the quantized integer code value and MaxCv is the code value that corresponds to the cv value at t M . Sub- 
stituting values we arrive at Equation 4. 



Equation 4: V = -I 1 

cv I 



[0013] Referring to Fig. 2, a code value (cv) of zero implies infinite light. The first measurable quantization, which is 
so also the largest, is between cv=1 and cv=2. The quantization for an 8 bit linear system is 0.0039, which is less than the 
smallest quantization in a time to threshold method described by Konuma . 

[0014] Fourthly, if one were to have a single counter and comparator used outside of the pixel array to keep track 
of the time to threshold, each pixel would then have to be measured at an extremely high rate in order to have a small 
enough sampling frequency per pixel to provide fine enough quantization for extension of the dynamic range. For exam- 
55 pie, assume that 1 0 bits of quantization over the desired exposure time is required, and that there are 1 million pixels in 
the image sensor. Given a desired exposure time of 100 msec, each pixel would have to be accessed and measured 
against the programmed threshold level every 97.65 usee. This means that 1 million pixels need to be sampled every 
97.65 usee. This would require a pixel sampling rate of 1 pixel per 97.65 psec, or 10.24 GHz. A means for doing this is 
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not disclosed by Konuma or elsewhere in the field of APS devices or other image sensor dev.ces. 
raoi51 Finally the output value provided is a time. In order to reconstruct the incident image from this output, (i.e. 
deteLe the one mu* extrapolate by multiplication from the time value. This can d legrade the eff ectiye 

no setevel of the sensor The value t is used to measure the time for a voltage v(t) to reach to a threshold. The s.gnal 

of photons overtime with some Gaussian addttive noise 
of ov One experienced in the art can show that the noise in the extended voltage doma.n (o Exl ) .s related to the add.t.ve 
noise as indicated by Equation 5. 
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100161 Given that t M is always greater than t T one can see that the value of o Ext is always greater than o„ From the 
King dtussion Should le apparent that' there remains a need within the prior art for a dev.e ^t provides 
extended Vsat and dynamic range while retaining low noise, small pixel, simple and low frequency readout, and means 
to manage the quantization of extended voltage signals. 

00% With the method of capturing two or more frames as disclosed by pr.or art references: Orty Yad,d-Pech et 
K ?W,det trascene Dynamic Range CMOS APS Using Dual Sampling"; 1997 IEEE Workshop on Charge-Coup ed 
Deuces and Advanced Image Sensors; paper #R15; O. Pecht et al., "CMOS APS with Autoscal.ng and Customized 
2 nvZnZ Ranae" 1999 IEEE Workshop on Charge-Coupled Devices and Advanced Image Sensors; and M. 
12i£7i "256T 2 56 CMOS ; imager wrthUnear Readout and 120dB Dynamfc Range-,- 1999 IEEE Workshop .on 
Cha^Coup ed Devices and Advanced Image Sensors, two or more frames of the same .mage or scene wrth different 
mSion times are captured, multiple readouts are required and the integration times for each readout murt be cho- 
sen .n a^ordance ^'the scene illuminance in order to get an accurate interpolation. This adds complex^ * MM 
fmaaina auto-exposure system to facilitate rapid choice of integration times and has not been shown in the art. Also 
S^ZZZZ^ is required to perform the multiple frame output comparison and cafoulation of effective s.gnal 
^Ad^ is any motionor change in scene illuminance between the 2 frames, this method of extending 

XT ra Wit 6 hte meThods of extending dynamic range described by: Sypros Kavadias et a.., "On-chip Offset Cali- 
brated Loaamhmi Response .mage Sensor" 1999 IEEE Workshop on Charge-Coupled Devices and Advanced Image 
Severe pp 68 71 M Loose et a. " Self-Calibrating Logarithmic CMOS Image Sensor wfth Single Chip Camera i Func- 
tional^' 1999 IEEE Workshop on Charge-Coupled Devices and Advanced Image Sensors, pp. 191-194; and N. R.c- 
Z * "Act ' PixeTcMOS image'sensor with On-Chip Non-Uniformity Correction", 1995 IEEE Workshop on 
Chame Coupled Devices and Advanced Image Sensors, a pixel with a logarithmic transfer function is P™^™> 
approach o! using a MOSFET sub-threshold exhibits behavior having very high fixed pattern noise Approaches to cor- 
dis require extra system memory, individual threshold trimming of each pixel, or extra transistors per pixel. Th,s 
40 increases chip size as well as system cost and complexity. i maaina with Hiah 

[0019] With the methods of extending dynamic described by J. Huppertz et al Fast CMOS Jmag.ng with High 
Dynamic Range", 1997 IEEE Workshop on Charge-Coupled Devices and Advanced ^T^^^^Sl 
Decker et al "Comparison of CCD and CMOS Pixels for a W.de Dynamic Range Area Imager-, 1 995 IEEE Workshop 
on C^rge Coupled Devices and Advanced Image Sensors, the reset gate voltage level is changed from an on^tate to 
an off s^ate with a specified time response during integration. With this method the dynamic range is extende l b y^ 
ming off charge to L reset drain for bright pixels so that the pixel does not saturate^ This method has the ^.sadvan- 
£ges of requiring complicated timing to operate in an electronic shutter mode, and difficulty in discern.ng whether or 
not a particular signal level is due to skimming of charge or is simply the total integrated s.gnal level 
m020] From the foregoing discussion rt should be apparent that there remains a need within the P™r art tor a 
device that retains provides extended dynamic range while retaining low noise, small pixel, s.ng.e frame readout, and 

SI tra tioSothe present invention, there is provided a solution to problems of the prior «t In the present 
nvent on burning behavior of CMOS based image sensors is used to provide extended .ntrascene dynamic range. 
EE? "embodiment of the present invention utilizes the charge that biooms from the photodetector dunng 
megrition ^art devices the signal leve. of the photodetector is limited in bright regions by removing ^Js^6- 
n ftte blooming charge. In the present invention the charge that blooms from the photodetector is .ntegrated for a 
ZSSSSSSti independent* from the photodetector integration time, and this collected bloom.ng charge .s 
added to the photodetector signal charge in the readout of the pixel. 
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[0023] A second embodiment of the present invention provides extended dynamic range by utilizing the behavior of 
diminishing signal with increasing light level associated with the readout of CMOS APS under high illumination levels. 
This is done by performing 2 samples of the reset level that have different elapsed times between reset and measure- 
ment of the reset level, thus providing 2 different effective reset level integration times. By comparing the 2 measured 

5 reset levels, one can determine the effective signal level of the photodetector beyond the physical saturation signal of 
the photodetector. The difference determined in the two reset measured levels is used to If the pixel is operating in the 
diminishing high light signal region, or in low light standard linear signal region. Depending on the result, a different 
transfer function is applied to voltage output from the from readout of the photodetector of that pixel to provide an effec- 
tive signal level for that pixel. If the light that is incident on that pixel is bright, and a difference in the 2 measured reset 

10 levels exceeds a predetermined threshold, a transfer function associated with the diminishing signal region will be used 
to calculate the photodetector value. If a difference in the 2 measured reset levels does not exceed a predetermined 
threshold value, then the standard linear transfer function will be used to identify that photodetector value. Additionally, 
the value of the measured difference can be used independently to calculate or determine the effective signal level or 
incident illumination level for that pixel. 

is [0024] According to the present invention, an active pixel sensor device that significantly increases the dynamic 
range of the device and can be used in current system designs is provided by an X-Y addressable MOS imager sensor 
method and apparatus wherein a semiconductor based MOS sensor having an array of pixels forming the X-Y address- 
able MOS imager, the X-Y addressable MOS imager having a plurality of the pixels such that each pixel within the plu- 
rality of pixels has a photodetector with a reset mechanism that adjusts the photodetector potential to a predetermined 

20 potential level employs the measuring a plurality of reset levels with two different elapsed times between reset and 
measurement of the reset level, a comparison circuit operatively coupled to the means for measuring to determine a 
difference in reset levels, a predetermined set of transfer functions used to identify effective signal levels of the photo- 
detectors, and determines from the difference which transfer function is applicable to that photodetector range of accu- 
mulated light. In response to the difference detected, transfer functions are applied to the charge read out from the 

25 photodetector. The transfer functions comprise a first transfer function that is pre-photodetector saturation function and 
a second transfer function that is a post-photodetector saturation transfer function. These transfer functions are applied 
to two reset levels of the photodetector within the same row readout period. The response to the difference can be the 
application of a series of digital adds and digital multiplies. The difference between the 2 reset levels is used to calculate 
the effective pixel signal level from the difference. 

30 [0025] The invention has the following advantages. It provides for extending the dynamic range of a sensor that can 
easily be employed within current pixel and sensor architectures with little or no modification. Small pixel with high fill 
factor can detect signal level out to 40.000X single frame capture standard read-out 

Fig. 1 is a diagram of a first embodiment of the present invention that extends the dynamic range by collecting 
35 charge that bloomed from the photodetector; 

Fig. 2a is diagram illustrating the operation of the pixel shown in Fig. 1 on a column basis where photodetector 
charge is added, and an associated timing diagram; 

Fig. 2b is diagram Illustrating the operation of the pixel shown in Fig. 1 on a column basis where photodetector volt- 
age is added , and an associated timing diagram; 

AO Fig. 3a illustrates a pair of transfer functions for the pixel in Fig. 1 operated by the timing diagrams shown in Fig. 2 

having a short floating diffusion integration time leading to a small slope for linear region 2; 
Fig. 3b illustrates a pair of transfer functions for the pixel in Fig. 1 operated by the timing diagrams shown in Fig. 2 
having a relatively longer floating diffusion integration time leading to a larger slope for linear region 2; 
Fig. 4 is a timing diagram used to illustrate the diminishing signal behavior shown in Fig. 5a; 

45 Fig. 5a is an illustration of a pixel cross section; 

Figs. 5b through 5d are electrostatic diagrams illustrating the effect of diminishing signal behavior for the pixel as 
illustrated; 

Fig. 6 is a timing diagram used to illustrate the diminishing signal behavior shown in Fig. 7a; 
Fig. 7a is an illustration of a pixel cross section; 
so Figs. 7b through 7d are electrostatic diagrams illustrating the effect of diminishing signal behavior for the pixel as 
illustrated; 

- Fig. 8a is a diagram illustrating the diminishing signal region; 

Fig. 8b is an expanded diagram illustrating the diminishing signal region; and 
Fig. 9 is a diagram illustrating the output o a sampled and held pixel. 

55 

[0026] The first embodiment of the present invention utilizes collection of charge that blooms from the photodetec- 
tor during integration. This is accomplished using the pixel shown in Fig. 1 . This is a similar pixel design to that disclosed 
by Guidash et al in U.S. Patent application 08/800,947. This pixel 1 0 comprises a photodetector 1 2 (preferably a pinned 
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photodiode PD). a transfer gate TG 1 6, a floating diffusion FD 1 8, a light shield 8 over at least the float.ng drffus.on 1 8, 
an input signal transistor and a reset transistor comprised of source floating diffusion 18, reset gate 17 ud^ctan 
1 9 A microlens 6 is provided to focus light onto the photodetector 1 2. Operation of the first embodiment of the present 
invention is shown in timing diagram of Fig. 2 for the pixel 10 of Fig. 1 resulting in the output signal transfer funct.on 
shown in Fig. 3. . 
[00271 Referring to Fig. 2a, which is diagram illustrating the operation of the pixel shown in Fig. 1 on a column basis 
wherein charge from photodetector 12, and floating diffusion 18, is added by in the charge domain on the float.ng diffu- 
sion, with the combined charge from the photodetector and floating diffusion read out through amplifier 22 and an 
associated timing diagram. The pixel 10 is reset or initialized by transferring charge from the photodetector 2 to the 
floating diffusion 1 8 by activation of the transfer gate 1 6 (shown as signal TG) and the subsequent resetting of the float- 
ing diffusion 18 by the activation of reset gate 17, which resets the floating diffusion 18 to a predetermined potential. 
The photodetector integration time {Upi ) commences when the transfer gate 16 is turned off after the mtoahza ,on or 
reset sequence, at time x,. The electrostatic potential of the transfer gate in its off state is set at a level deeper than 0 
volts so that excess charge in the photodetector will bloom through the transfer gate region and into the floating diffusion 
18. As photodetector integration time (t intpd ) proceeds, the photodetector 1 2 will fill up with photoelectrons. If the ,nc,- 
d nt light is bright, the number of photoelectrons generated in that pixel will exceed the capacity of the photodetector 
1 2 At this point the excess charge will spill into the floating diff usion 1 8. If the reset gate 1 7 is on when charge begins 
to spill onto the floating diffusion 18. this charge will be swept through the reset gate 17 region to reset drain 19 leaving 
the floating diffusion at the same predetermined potential, typically a threshold voltage below that of the reset dram 1 9 
(VDD) If the reset gate 1 7 is off when charge begins to spill into the floating diffusion 1 8, then this charge will be co^ 
lected in the floating diffusion 1 8. The amount of time that RG is turned off during the photodetector integrate period 
is referred to as the floating diffusion integration time Wo. _ -o ■.♦„„„ 

[0028] Atthe end of desired photodetector integration time t intpd , the signal charge in the photodetector 12 is trans- 
ferred to the floating diffusion 1 8 by pulsing the transfer gate 1 6 on and off at time x*. The signal level of the f oa ,ng 
diffusion 1 8 is then sampled by SHS and held on capacitor C v If no blooming charge has been collected on the float.ng 
diffusion 18 during the floating diffusion integration time t lntfd .(i.e. a dark region of the image), then the signal charge 
on capacitor C, from the floating diffusion 18 comprises the charge collected in the photodetector 12 dunng .ntegra ion. 
If blooming charge has been collected on the floating diffusion 1 8, then the signal charge on the capacitor C, from float- 
ing diffusion 18 comprises the charge collected in the photodetector 12 during photodetector integrat.cn time (t^). 
plus the charge collected in the floating diffusion during the floating diffusion integration time. This floating diffusion inte- 
gration time w is the time elapsed from when reset gate 1 7 is turned off to when the signal charge is transferred from 
the photodetector 12 at time x 2 . The floating diff usion integration time tj ntfd is controlled separately and .ndependently 
from the photodetector integration time ti ntpd . 

r00291 As a result of the operation described for Fig. 2a the sensor output response will be as shown in Figures 3a 
and 3b The output response comprises 2 regions. For low light levels the output response will follow linear region 1 . As 
the number of photoelectrons exceeds the capacity of the photodetector, this charge will be collected on the floating dif- 
fusion and added to the photodetector signal charge. In this case the pixel output response will follow region 2. The pre- 
ferred embodiment provides a linear response in region 2, by the timing shown In Fig. 2a. A non-linear response could 
be g nerated by having a time varying reset gate potential level as described in the prior art reference by S. Decker eX 
al "A 256 x 256 CMOS Imaging Array with Wide Dynamic Range Pixels and Column-Parallel Digital Output , IEEE 
Journal of Solid State Circuits, Vol 33, No. 12, Dec. 1998. In the preferred embodiment, the output response in region 
2 is lin ar and the slope is dependent on and directly proportional to the floating diffusion integration time t, ot(<1 . The two 
Figures (3a and 3b) illustrate the 2 different slopes for region 2. The floating diffusion integration time in F.g. 3a is 
shorter than that for Fig 3b. Consequently, the slope of region 2 in Fig 3b. is greater than that for F.g. 3a 
[0030] Since the floating diffusion integration time Wd known, the effective signal level of the p.xel can be deter- 
mined by Equation 6. 

Veff= Vo ut for Vo ut < Vpdsat Equation 6 

Veff= Vpdsat + (Vo ut - Vpdsat)(t pdint /t {dint ) for Vo ut > Vpdsat 

Since the ratio of the photodetector integration time t^ to the floating diffusion integration time t inlfd can be made 
large Veff can be increased substantially over the signal limited by the photodetector capacity. Hence the dynamc 
range is extended. Additionally, the maximum vortage level. Vmax, which is determined by the floating drff usion charge 
capacity can be larger than that of the photodetector capacity by controlling the capacitance of the floa ing diffusion. It 
is also possible to display the sensor output signal directly without determining the effective signal level from region 2 
This still provides extended instrascene dynamic range by mapping and directly displaying a larger incident illuminant 
range into the directly detectable signal voltage range. Also, the level of Vpdsat can be programmed by setting the off 
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level of the transfer gate 1 6 to the desired level. 

[0031] The timing shown in Fig. 2a shows a single readout of the total combined charge on the floating diffusion 
that comprises the photodetector signal and the collected blooming charge. The signal is read first followed by a reset 
and then a measurement of the reset level. This is an uncorrelated double sample readout, which adds temporal reset 

5 noise to the signal, it is possible to accomplish readout of the photodetector signal level and floating diffusion blooming 
charge level by performing 2 readouts. This is shown in Fig 2b. In this manner the level of blooming charge collected on 
the floating diffusion 18 is sampled and held by pulsing SHS fd which places the blooming charge on Capacitor C 4 , fol- 
lowed by a reset of the floating diffusion 18 by RG and a sample and hold of the reset level by SHR which places the 
reset level on Capacitor C 5 . Charge is then transferred from the photodetector 12 to the floating diffusion 18 and that 

10 signal level is then sampled and held by SHSp^ and placed on Capacitor C 6 . The present Invention envisions a differ- 
ential readout for the stored blooming charge on capacitor C 4 and the reset level on capacitor C 5 via differential ampli- 
fier 31 , and a second differential readout for the stored signal charge on capacitor C 6 and the reset level on capacitor 
C 5 via differential amplifier 32, thus providing true correlated double sampling for the photodetector signal level. The 
final output signal can then be determined by several means. One is reading the signals from the 2 differential amplifiers 

is 31 and 32 separately providing 2 signal values per pixel that can be added off-chip. A second embodiment is accom- 
plished by providing the signals as inputs to a 3 rd differential amplifier and reading the signal out as a single level per 
pixel. This readout method of combining the signal in the voltage domain also provides a larger Vmax than combining 
the signals in the charge domain. This is because the floating diffusion does not have to hold the photodetector signal 
and blooming signal simultaneously. Hence the Vmax is extended to be the full floating diffusion capacity plus the pho- 

20 tod tector capacity. 

[0032] Since this method utilizes differential readout of the pixel with respect to a reference reset level, the pixel off- 
set noise is cancelled. Additionally the dynamic range is extended without any additional components in the pixel, so 
that it can be accomplished with small pixels that are practical for low cost consumer digital imaging applications. With 
this approach pixel read noise will be increased by KTC due to the reset level being uncorrelated to the signal level. This 

25 will be typically less than 30 electrons and is small compared to the gain in effective signal level. 

[0033] The second embodiment of the present invention also utilizes blooming behavior to extend dynamic range. 
In CMOS APS and PPS devices it is pointed out that as the incident light level becomes extremely bright, the output 
signal determined from the difference between the signal level and a reset level is perceived to decrease with increasing 
light levels, eventually reaching a "black" level This diminishing signal behavior is due to the effect of the reset level 

30 decreasing as a result of charge accumulating on the charge to voltage conversion node, typically referred to as a sense 
node, during the time between reset and when the reset level is sampled and held. This occurs either by blooming 
charge from a separate photodetector being collected during on the sense node in the case of a 4 transistor APS, or by 
accumulation of electrons in the photodetector that also functions as the sense node in the case of three transistor APS 
pixels, or in the case of PPS pixels. If uncorrected, this diminishing signal effect with increasing incident light levels may 

35 be undesirable. 

[0034] Cross sectional diagrams of the relevant region of pixels envisioned to operate under the second embodi- 
ment of the present invention are shown schematically in Figs. 5a and 7a with corresponding timing diagrams of Figs. 
4 and 6. The pixel 20 shown In Fig. 5a and the corresponding timing diagram of Figs. 4 are for the case of either a 3 
transistor APS device where the photodetector serves as the charge to voltage conversion node, and also or for the 
40 case of a PPS device. The pixel 30 shown in Fig. 7a and the corresponding timing diagram of Figs. 6 are for the case 
of an APS where the charge to voltage conversion node (floating diffusion 38) is separate and isolated from the photo- 
detector 32. 

[0035] Referring to Figs. 4 and 5a, which is the case of three transistor APS devices and PPS devices, the pixel 20 
is initialized by resetting the photodetector 22 when RG 27 is pulsed on and off. Integration of signal in the photodetec- 

45 tor now commences. As integration proceeds the electrostatic potential of the photodetector VPD decreases until the 
photodetector 22 has completely filled up with photoelectrons. At this point the VPD is approximately 0 volts. The signal 
level of the photodetector 22 is then sampled and held by strobing SHS. Next the photodetector is reset by strobing RG 
27 in order to provided a reference level differential readout of the signal from photodetector 22. The time elapsed 
between the reset and sample and bold of the reset level is typically a few \\sec. If the incident light level during this 

so elapsed time is low, the reset level will not change appreciably and will be extremely close to the nominal reset level RL0 
as shown in Fig. 5b. If this incident light is very bright, the reset level can change during this elapsed time if the sensor 
is not shielded from the incident light. The example seen in Fig. 5c is for a very bright incident light level that causes the 
photodetector voltage VPD to go to reset level RLA. Since the readout of the output signal level is determined by the 
difference between the signal level and the reset level, the perceived output signal level will decrease because the full 

55 photodetector level is compared against RLA rather than RL0. If the incident light level is bright enough to completely 
fill the photodetector in the time between reset and sample and hold of the rest level, the photodetector will reach a reset 
level RLB as seen in Fig. 5d. In this case the difference between the sampled and held signal level and the sampled 
and held reset level is zero, producing a black or dark image. This produces a diminishing signal region with increasing 
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resetl , or reset2-reset1 to read out through the 8 bit ADC. 
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Claims 

1. A X-Y addressable MOS imager sensor comprising: 

5 a semiconductor based MOS sensor having an array of pixels forming the X-Y addressable MOS imager, the 

X-Y addressable MOS imager having a plurality of the pixels such that each pixel within the plurality of pixels 
has a photodetector with a reset mechanism that adjusts the photodetector potential to a predetermined poten- 
tial level; 

means for measuring a plurality of reset levels with two different elapsed times between reset and measure- 
to ment of the reset level; 

a comparison circuit operatively coupled to the means for measuring to determine a difference in reset levels; 
a predetermined set of transfer functions used to identify effective signal levels of the photodetectors; 
means for determining from the difference which transfer function is applicable to that photodetector range of 
accumulated light; and 

15 means responsive to the means for determining for applying the transfer function to the charge read out from 

the photodetector. 

2. The invention of claim 1 wherein the predetermined set of transfer functions further comprises at least a first trans- 
fer function that is pre -photodetector saturation function and a second transfer function that is a post-photodetector 

20 saturation transfer function. 

3. The invention of claim 2 wherein the means for measuring further comprises means for measuring two reset levels 
of the photodetector within the same row readout period. 

25 4. The invention of claim 2 wherein means responsive further comprises means for applying a series of digital adds 
and digital multiplies. 

5. The invention of claim 1 wherein the comparison means compares the different reset periods with respect to a pre- 
determined threshold. 

30 

6. The invention of claim 1 wherein the means for measuring further comprises means for measuring the difference 
between the 2 reset levels and using this difference to calculate the effective pixel signal level. 

7. A method of using an X-Y addressable MOS imager sensor for increased dynamic range comprising the steps of: 

35 

providing as the X-Y imager a semiconductor based image sensor having an array of pixels formed in rows and 
columns such with a plurality of the pixels formed such that each pixel within the plurality of pixels has a pho- 
todetector with a reset mechanism that adjusts the photodetector potential to a predetermined potential level; 
measuring a plurality of reset levels for each of the plurality of pixels with two different elapsed times between 
AO reset and measurement of the reset level; 

comparing the measured reset levels to determine a difference in the reset levels; 

applying a predetermined set of transfer functions to the difference; 

determining from the applying step amount of light incident upon the photodetector. 

45 8. The method of claim 15 wherein the applying step further comprises applying a first transfer function that is pre- 
photodetector saturation function and a second transfer function that is a post-photodetector saturation transfer 
function. 

9. The method of claim 15 wherein the measuring step further comprises measuring two reset levels of the photode- 
50 tector within the same frame time period. 

10. The method of claim 1 5 wherein the determining step further comprises applying a series of digital adds and digital 
multiplies. 

55 



5DOCID: <EP 1096 789 A2_L> 



9 



EP 1 096 789 A2 




©OCID- <EP 10967B9A2J_> 



EP 1 096 789 A2 
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